Multimodality and Ambient Intelligence

In this report we discuss multimodal interface technology. We present examples of multimodal interfaces and show problems and opportunities. Fusion of modalities is discussed and some roadmap discussions on research in Multimodality are summarized. This report also discusses future developments where rather than communicating with a single computer, users communicate with their environment using multimodal interactions and where the environmental interface has perceptual competence that includes being able to interpret what is going on in the environment. We contribute roles to virtual humans in order to allow daily users of future computing environments to establish relationships with the environments, or more in particular, these virtual